A NOTE ON INVARIANT DIFFERENTIAL OPERATORS ON 

SIEGEL-JACOBI SPACE 



JAE-HYUN YANG 

Abstract. For two positive integers m and n, we let H„ be the Siegel upper half 
plane of degree n and let C^" 1 '™- 1 be the set of all m x n complex matrices. In this 
article, we investigate differential operators on the Siegel- Jacobi space H„ x C,( m > n > 
that are invariant under the natural action of the Jacobi group Spin, R) x H^' m ^ 
on H„ x C( m,n ), where H^' m ' denotes the Heisenberg group. 



1. Introduction 

For a given fixed positive integer n, we let 

H n = {Qe C (n ' n) | Q = ImQ > } 

be the Siegel upper half plane of degree n and let 

Spin, R) = {M e R^ 2 ™' 2 ") I l MJ n M = J n } 

be the symplectic group of degree n, where F^ k ^ denotes the set of all k x I matrices 
with entries in a commutative ring F for two positive integers k and Z, t M denotes 
the transpose matrix of a matrix M and 

In 

-L 



J n 



Spin, R) acts on M. n transitively by 

(1.1) M-n= (AQ + B)(CQ + d)- 1 , 

where M = e Spin, R) and to G H„, 

For two positive integers m and n, we consider the Heisenberg group 

H^ n ' m) = { (A,//; /c) | A,jttG R (m ' n) , k G R( m ' m ), « + /x*A symmetric } 
endowed with the following multiplication law 

(A, fx; k) o (A', //; k) = (A + A', \i + //'; k + k' + A '//' — /x *A') . 

We define the semidirect product of Sp(n, R) and H^' m ^ 

G J = Sp[n, R) x H^' m) 
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endowed with the following multiplication law 

(M, (A, y.\ k)) ■ [M 1 , (A', //; k' )) = (MM', (A + A', p, + //; k + «' + A V - /2 'A' )) 

with M, M' G Sp(n, R), (A, //; k), (A', //; «') G tfjf^ and (A, /I) = (A, yi)M'. Then G J 
acts on H n x C (m ' n) transitively by 

(1.2) (M, (A, //; k)) ■ (n, Z) = (m • 0, (Z + Aft + + D)" 1 ) , 

where M = ^ G Sp(n,R), (X,/i;k) G i4 n,m) and (Q,Z) G H„ x C( m ' n ). 

We note that the Jacobi group G J is not a reductive Lie group and also that the 
space H n x <C^ m ' n ^ is not a symmetric space. We refer to [1, 3, 16-19, 21-25] about 
automorphic forms on G J and topics related to the content of this paper. From now 
on, for brevity we write EI n!m = H n x C^ m ' n \ 

The aim of this paper is to study differential operators on H n>m which are invariant 
under the action (1.2) of G J . This article is organized as follows. In Section 2, we re- 
view differential operators on H n invariant under the action (1.1) of Sp(n, K). We let 
D(H„) denote the algebra of all differential operators on H n that are invariant under 
the action (1.1). We briefly describe the work of Maass [10] about constructing ex- 
plicit algebraically independent generators of D(H„) and Shimura's construction [12] 
of canonically defined algebraically independent generators of D(H ri ). In Section 3, 
we investigate differential operators on M. nt7n invariant under the action (1.2) of G J . 
For two positive integers m and n, we let 

T n>m = { (u, z) | u = *w G C ( "' n) , z G C (m ' n) } 

be the complex vector space of dimension n( - n 2 +1 ^ + mn. We have a natural action of 
the unitary group U (n) on T n m given by 

(1.3) u-{uj 1 z)= (uu t u,z t u), u<EU(n), (u, z) G T njTn . 

The action (1.3) of U(n) induces naturally the representation r of U(n) on the poly- 
nomial algebra Pol(T njm ) consisting of complex valued polynomial functions on T„ jm . 
We show that the study of differential operators on H„ im invariant under the action 
(1.2) of G J is equivalent to that of polynomials on T n m that are invariant under the 
representation r of U(n) on Pol(T„ )m ). Let Po\(T ntm ) u ^ denote the subalgebra of 
Pol(T n>m ) consisting of all polynomials on T n m invariant under the representation 
t of U(n), and B(H njm ) denote the algebra of all differential operators on H„ m in- 
variant under the action (1.2) of G J . We note that D(H njm ) is not commutative. 
The main important problem is to find explicit algebraically independent generators 
of Pol(T n>m ) u ( n ' and algebraically independent generators of D(H niTO ). We provides 
many [/(n)-invariants in Po\{T njm ) u ^ which may contain algebraically independent 
generators of Po\(T n , m ) u<yn \ We also provides some explicit G J -invariant differential 
operators on H n m that are obtained by complicated computations. As an example, 
we give explicit algebraically independent generators of D(Hx,i). We want to mention 
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that at this moment it is quite complicated and difficult to find the generators of 
the algebra of all invariant differential operators on H nim and to express invariant 
differential operators on H n)m explicitly. 



2. Invariant differential operators on H n 

For Q = (ujij) G H n , we write Q = X + i Y with X = (x^), Y = (yy) real. We put 
dfl = (doJij) and dVL = [dUJij). We also put 

d fl + du d \ , d fl + 5 i:! d 



and -= 



dtt V 2 duJ ij J ' dtt \ 2 duJij 

Then for a positive real number A, 

(2.1) ds 2 n . A = A tr (Y^dtt Y^dU 

is a Sp(n, R)-invariant Kahler metric on IH n (cf. pT3| E]), where tr(M) denotes the 
trace of a square matrix M. H. Maass [9] proved that the Laplacian of ds n . A is given 
by 

(2.2) A n . A = itr (V (y-i^^T 

And 

^„(fi)=(dety)-(" +i ) n n ^ 

is a Sp(n, M)-invariant volume element on H n (cf. [14, p. 130]). 

For brevity, we write G = Sp(n,~R). The isotropy subgroup K at il n for the action 
(1.1) is a maximal compact subgroup given by 



K 



A -B 
B A 



A l A + B l B = I n , A t B = B% A5gR m 



Let t be the Lie algebra of K. Then the Lie algebra q of G has a Cartan decomposition 
= t © p, where 

P = { fy Jx) x= l x,Y= % x, y e R (n - n) j . 

The subspace p of q may be regarded as the tangent space of H n at il n . The adjoint 
representation of G on g induces the action of K on p given by 

(2.3) k- Z = kZ f k, keK, Z G p. 

Let T n be the vector space of nxn symmetric complex matrices. We let ^ : p — ► T n 
be the map defined by 

(2.4) *((* _ Y X )) = X + ,Y, ($ y x ) er . 
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We let 5 : K — > U (n) be the isomorphism defined by 
(2.5) S ((i -?]) = A + iB, (i !') 



B A ) ) ' \B A 

where U (n) denotes the unitary group of degree n. We identify p (resp. K) with T n 
(resp. U(n)) through the map \P (resp. 5). We consider the action of U(n) on T n 
defined by 

(2.6) h-Z=hZ% heU{n),ZeT n . 

Then the adjoint action (2.3) of K on p is compatible with the action (2.6) of U(n) 
on T n through the map \f r . Precisely for any k G K and uo G p, we get 

(2.7) ^(ku'k) = 5{k)^(u) t 5{k). 

The action (2.6) induces the action of U (n) on the polynomial algebra Pol(T n ) and the 
symmetric algebra S(T n ) respectively. We denote by Po\(T n ) u ^ (resp. S(T n ) u ^ ) 

the subalgebra of Pol(T n ) ^resp. S(T n )^j consisting of [/(n)-invariants. The following 
inner product ( , ) on T n defined by 

(Z,W)= tr(ZW), Z,WeT n 
gives an isomorphism as vector spaces 

(2.8) T n ^T* n , Z^f z , ZeT n , 

where T* denotes the dual space of T n and f z is the linear functional on T n defined 
by 

fz(W) = (W,Z), WeT n . 

It is known that there is a canonical linear bijection of S(T n ) u ^ onto the algebra 
D(H n ) of differential operators on H n invariant under the action (1.1) of G. Identifying 
T n with T* by the above isomorphism (2.8), we get a canonical linear bijection 

(2.9) $ : ¥o\(T n ) ui - n) — ► D(H„) 

of Vo\{T n ) u{ ^ onto 0(H n ). The map $ is described explicitly as follows. Similarly 
the action (2.3) induces the action of K on the polynomial algebra Pol(p) and the 
symmetric algebra S(p) respectively. Through the map the subalgebra Pol(p)^ of 
Pol(p) consisting of i^-invariants is isomorphic to Pol(T n ) u ( n \ We put N = n(n + 1). 
Let {£ a | 1 < a < N } be a basis of p. If P G Pol(p)* then 

(2.10) (*{P)f)(gK) = P (J^ f ^exp K 



(t a )=o 



where / G C°°(M n ). We refer to [6, 7] for more detail. In general, it is hard to express 
$(P) explicitly for a polynomial P G Pol(p)^. 

According to the work of Harish- Chandra [4,5], the algebra D(H n ) is generated 
by n algebraically independent generators and is isomorphic to the commutative ring 



n. 
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C[xi, ■ ■ ■ , x n ] with n indeterminates. We note that n is the real rank of G. Let Qc be 
the complexification of g. It is known that D(H n ) is isomorphic to the center of the 
universal enveloping algebra of Qc- 

Using a classical invariant theory (cf. [H [13] . we can show that Pol(T n ) u ^ is gen- 
erated by the following algebraically independent polynomials 

(2.11) qj (Z)= ti{[ZZ) 3 ), j = 1,2,- 

For each j with 1 < j ' < n, the image <&(qj) of qj is an invariant differential operator 
on H n of degree 2j. The algebra D(H n ) is generated by n algebraically independent 
generators &(qi), $(92), • • • , $(<7n)- In particular, 

f Y 9 \a \ 

(2.12) $(91) = Citrl Y I 1— — for some constant c\. 

V V dVt J oil J 

We observe that if we take Z = X + iY with real X, Y, then q±(Z) = qi (X,Y) = 
tr(X 2 + F 2 )and 

q 2 (Z) = q 2 {X,Y) = tr((X 2 + F 2 ) 2 + 2X(XY -YX)Y^. 

It is a natural question to express the images explicitly for j = 2,3, • • • ,n. 

We hope that the images <&(qj) for j = 2, 3, • • • , n are expressed in the form of the 
trace as $(gi). 

H. Maass [10] found algebraically independent generators H 1 ,H 2 ,--- , of B(H„). 
We will describe Hi, H 2 , ■ ■ ■ , H n explicitly. For M = G Spin, E) and Q = 

X + iY G Hn with real X, Y, we set 

fi* = M-VL = X* + iF* with X*, Y* real. 



We set 



Then it is easily seen that 

(2.13) X, = t (Cll+D)- lt {{Ctt + D) t K} , 



(2.14) 



A, = \Ctt + D)- lt {(Ctt + D)^} 
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and 

(2.15) '{(Cft + D)'A} = A^CD + D) - —— (D-D)^. 
Using Formulas (2.13), (2.14) and (2.15), we can show that 

n -\- 1 *f V Tj-i-i 

(2.16) A*K* + ^—K, = \CD + D)- 1 I (CD + D) [ AK + — -—K 



2 v 1 V 2 

Therefore we get 

(2.17) tr(A*X* + ! ^ L ^*) = tr^Atf + ^^Kj . 
We set 

(2.18) A« = AK + — K 
We define (j — 2, 3, • • • , n) recursively by 

(2.19) AO = AWA^-^A^- 1 ) + l -Aa(A^) 

+ 1 -(n-D) t {{D-D)- lt { t A W-V) } . 

We set 

(2.20) if,- = tr(Atf)) , j = 1,2, ...,n. 

As mentioned before, Maass proved that Hi, H 2 , ■ ■ ■ , H n are algebraically independent 
generators Hi, H 2 , • ■ • ,H n of D(H n ). 

In fact, we see that 

(2.21) -Hi = A n ,i = 4tr(V (y 9 ' " 



3D J 3D 

is the Laplacian for the invariant metric ds^ on H n . 

Conjecture. For j — 2, 3, • • • , n, &(qj) = Cj Hj for a suitable constant Cj. 

Example 2.1. We consider the case n = 1. The algebra Po\(Ti) u ^ is generated by 
the polynomial 

q(z) = zz, z G C. 

Using Formula (2.10), we get 

/ d 2 d 2 



<9x 2 <9y 2 



Therefore D(Hi) = C [$(?)] = C[ifi]. 
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Example 2.2. We consider the case n = 2. The algebra Pol^) is generated by 
the polynomial 

qi (Z) = tr(ZZ), q 2 (Z) = tr((ZF) 2 ), Z G T 2 . 

Using Formula (2.10), we may express $(gi) and &(q 2 ) explicitly. $(gi) is expressed 
by Formula (2.12). The computation of $(^2) might be quite tedious. We leave the 
detail to the reader. In this case, &(q 2 ) wa s essentially computed in [2], Proposition 
6. Therefore 

D(H 2 ) = €[<%!), $(g 2 )] = C[H U H 2 ]. 
They computed the center of the universal enveloping algebra % (0c)- 

G. Shimura [12] found canonically defined algebraically independent generators 
of B(H n ). We will describe his way of constructing those generators roughly. Let 
Kc, 0c, tc, Pc, • ■ ■ denote the complexication of K, q, t, p, ■ • ■ respectively. Then we 
have the Cartan decomposition 

0c 6 C + p c , p c = Pc + P; 

with the properties 

[tc, Pel c Pc, [Pc, P^} = [Pc, Pel = {°}> (Po Pel = *c» 

where 



0c 



{ (xl I X i' X 2,X 3 G C^ n \ X 2 = *X 2 , X 3 = % J 



A -B 
B A 



^ ^(2n,2n) 



l A + A = 0, B = % B 



Pc 
Pc 



X Y 
Y -X 

Z iZ 

iZ -z 

Z -iZ 
-iZ -z 



g jQ(2n,2n) 



^ jQ(2n,2n) 



x = t x, y = *y 
z = l z e c {n ' n) 



^ jj-N(2n,2n) ^ ^ jQ(n,n) 



For a complex vector space and a nonnegative integer r, we denote by Pol r (W) 
the vector space of complex- valued homogeneous polynomial functions on W of degree 
r. We put 



Pol r (W) := J2 Po UW). 



s=0 



Ml r (W) denotes the vector space of all C-multilinear maps of W x • ■ ■ x W (r copies) 
into C. An element Q of ML.(W) is called symmetric if 
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for each permutation ir of {1, 2, • • • , r}. Given P G Pol r (W^), there is a unique element 
symmetric element P* of ML(W^) such that 

(2.22) P(x) = P*(x, ■ ■ ■ , x) for all x e W. 

Moreover the map P i— > P* is a C-linear bijection of Pol r (VF) onto the set of all 
symmetric elements of Ml r (W). We let S r (W) denote the subspace consisting of all 
homogeneous elements of degree r in the symmetric algebra S(W). We note that 
Pol r (W) and S r (W) are dual to each other with respect to the pairing 

(2.23) {ot,Xi ■ ■ -x r ) — ct m (xi, • • • ,x r ) (x,i G W, a G Pol r (W)). 

Let p£ be the dual space of pc, that is, p'. = Poli(pc). Let {Xl, ■ ■ ■ , X N } be a basis 
of pc and {Yi, • • • , Y N } be the basis of p c dual to {X v }, where N = n(n + 1). We 
note that Pol r (pc) and PoL(p c ) are dual to each other with respect to the pairing 

(2.24) (a, /3> = 5>(X n ,..., X ir ) P*(Y h , ■ ■ ■ , Y ir ), 

where a G PoL(p c ), @ G Pol r (p c ) and ■ ■ ■ ,i r ) runs over {1, • • • , N} r . Let % (0c) 
be the universal enveloping algebra of 0c an d ^ p {Qc) its subspace spanned by the 
elements of the form V\ • ■ ■ V s with Vi G 0c an d s < p. We recall that there is a C-linear 
bijection ip of the symmetric algebra S(gc) °f 0c on to % (0c) which is characterized 
by the property that i>{X r ) = X r for all X G 0c- For each a G PoL(p^) we define an 
element u(a) of W(qc) by 

(2.25) u;(a) := ^ a*(Y n , • • • , Yj X n • • -X ir , 

where (ii, ■ ■ ■ , i r ) runs over {1, • • • , N} r . If Y G pc, then Y r as an element of Pol r (p£) 
is defined by 

Y r {u) = Y(u) r for all u G p c . 

Hence (F r )*(-Ui, • • • , u r ) = Y(ui) ■ ■ ■ Y(u r ). According to (2.25), we see that if a(J2 UYi) — 
P(ti, • • • , t N ) for ti G C with a polynomial P, then 

(2.26) co(a)= *P(P(X ir -- ,X N )). 

Thus u> is a C-linear injection of Pol(p£) into ^(Qc) independent of the choice of 
a basis. We observe that u;(Pol r (p£)) = ip(S r (pc))- It is a well-known fact that if 
, a rn G Pol r (pc), then 

(2.27) u(a 1 ---a m )-u(a 1 )---u(a 1 ) G ^ r_1 (0c)- 

We have a canonical pairing 

(2.28) ( , ) : PoL(p+) x Pol r (Pc) — > C 
defined by 

(2.29) (/,<?> = J]/*(^i>--- A)^,--. ,y ir ), 

where /* (resp. </*) are the unique symmetric elements of Ml r (pJ) (resp. Ml r (p^)), 
and {Xi, ■ ■ ■ ,Xfi} and {Yi, • • • , Y^} are dual bases of pj and p^ with respect to 
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the Killing form B(X, Y) = 2(n + 1) tr(XY), N = ^fll , and (i u ■ ■ ■ , i r ) runs over 

{i,-,jf} r . 

The adjoint representation of Kc on p^ induces the representation of Kc on 
PoL(p^). Given a Kc-hreducible subspace Z of PoL.(pJ), we can find a unique 
fTc-irreducible subspace W of PoL(p^) such that Pol. r (p^) is the direct sum of W 
and the annihilator of Z. Then Z and W are dual with respect to the pairing (2.28). 
Take bases {0, • • • , C«} °f % an d {6i> ' ' ' > £k} °f W that are dual to each other. We 
set 

K 

(2.30) f z (x, y)=J2 ( x G Pc> 2/ G Pc)- 

It is easily seen that fz belongs to Pol 2r (pc) X an d is independent of the choice of 
dual bases {( u } and {£„}• Shimura [12] proved that there exists a canonically de- 
fined set {Zi,--- , Z n } with a Kc-hreducible subspace Z r of Pol r (p { t) (1 < r < n) 
such that jzxi • • • , fz„ are algebraically independent generators of Po\(pc) K . We can 
identify pj with T n . We can take Z r as the subspace of Pol r (T n ) spanned by the 
functions f a;r (Z) = det r ( t aZa) for all a G GL(n, C), where det r (a;) denotes the de- 
terminant of the upper left r x r submatrix of x. For every / G Pol(pc) x , we let 
denote the element of D(H n ) represented by ui(f). Then D(H n ) is the polyno- 
mial ring C[u(fz 1 ), ■ ■ ■ ,^(fz n )] generated by n algebraically independent elements 
u(fzi),--- ,u(fzj- 

3. Invariant differential operators on H n m 

The stabilizer K J of G J at (il n , 0) is given by 

K J = | (k, (0, 0; k)) \ k e K, k = 1 k E R {m ' m) }. 

Therefore H njm = G J / K J is a homogeneous space of non-reductive type. The Lie 
algebra g J of G J has a decomposition 

J = t J + P J , 

where 

£ J = { (X, (0, 0,«))|l£!, « = */c G M (m ' m) }, 

p J = | (F, (P, Q, 0)) | Y G p, P, Q G M (m ' n) }. 

Thus the tangent space of the homogeneous space H n>m at (iJ n , 0) is identified with 
p J . We can see that 

[t J ,t J ]ct J , [t J ,p J ]Cp J . 
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The adjoint action of K J on p J induces the action of K on p J defined by 

(3.1) k-z= kz% keK, z ep J . 

Identifying R( m ' n ) x R( m < n ) with C (m ' n) , we can identify p J with T n x C (m - ra) . For 
brevity, we write T n , m = T n x C^ m ' n K Through this identification the action (3.1) is 
compatible with the action of U (n) on T„ im defined by 

(3.2) h- (u,z) = {hu l h, z l h), 

where h G K, w G T n and z G C*" 1 '™). Here we regard the complex vector space T n>m 
as a real vector space. 

We now describe the algebra D(H„ i?n ) of all differential operators on H n rrt invariant 
under the action (1.2) of G J . The action (3.2) induces the action of U(n) on the 
polynomial algebra Pol„ irrt = Pol(T„ jm ). We denote by PolJ^ the subalgebra of 
Pol nim consisting of all [/(n)-invariants. Similarly the action (3.1) of K induces the 
action of K on the polynomial algebra Pol(p J ) . We see that through the identification 
of p J with T n>m , the algebra Pol(p J ) is isomorphic to Pol„ ;m . The following U(n)- 
invariant inner product ( , )* of the complex vector space T„ iJn defined by 

((u,z),(u',z'))^ = tr(uU)+tr(z t ^), (cu,z), (cu',z') G T n>m 

gives a canonical isomorphism 

T n , m = T*^ m , (uj,z) h-> fv jZ , (uj,z) G T„ >m , 

where f UiZ is the linear functional on T n m defined by 

fu,z((w',z')) = ((u',z'),(u),z))^ (uj',z') GT njm . 

It is known that one gets a canonical linear bijection of S(T n>m ) u ^ onto D(H„ im ). 
Identifying T n)Tn with T*^ m by the above isomorphism, one gets a natural linear bijec- 
tion 

© : P<S? — D(H»,m) 

of Poffi onto D(H n , m ). The map 6 is described explicitly as follows. We put N* = 

n(n + 1) + 2mn. Let {q a | 1 < a < } be a basis of p J . If P G Pol(p J )^ = Pol^, 
then 

(3.3) (e(P)/) (gK) = P (J^j f [g exp ^ t aVa j K 



(t a )=0 



where / G C°°(E[ nim ). In general, it is hard to express Q(P) explicitly for a polynomial 



P G Pol(p J )^. We refer to [7], p. 287. 
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We present the following basic i^-invariant polynomials in Pol^^ . 

(3.4) Pj (u,z) = tY((uLjy), l<j<n, 

(3.5) ^\u,z)= {z l z) kk , l<k<m, 

Re (z l z)k p , 1 < k < p < m, 
Im(z*z)fcp, 1 < k < p < m, 
Re (zZJ t z)k p , 1 < k < p < m, 
Im (zuJ t z )k p , 1 < k < p < m, 



n 



(3.6) 
(3.7) 
(3.8) 
(3-9) 

where w£T„ and z e C (m - n) . 



kp 



We present some interesting fT-invariants. For an m x m matrix 5, we define the 
following invariant polynomials in Pol^^: 



(3.10) 
(3.11) 
(3.12) 
(3.13) 



(!) I 

m). J s {uj,z 



Re (tr(uZJ + l zSzY j, 1 < j < n, 
m^) s (u,z) = Im (tr(uuj + t zSzy^j, 1 < j < n, 
q ( k f s (uj,z) = Re (tr(( l z S z) k )^j , 1 < k < m, 
q { k f s (u,z) = Im (tr (CzSz) k )^, 1 < k <m, 

= ^e(tr((u;ujyCzSz) k (u;uJ+ *zSz) 



(3.14) 

(3.15) d ?l 3] s^iz) = Im (tr ((ujuj) 1 C z S z) k {ujuj + l zSz) j 

where 1 < i, j < n and 1 < k < m. 

We define the following ^-invariant polynomials in Pol^- 1 . 

(3.16) rf k \u, z) = Re (tr((a;w) J ' ( t zz) k )) , 1 < j < n, 1 < k < m, 



(3.17) 



(2), 



,z) = Im (tr((cucJ) j l<j<n, 1 < k < m. 



There may be possible other new invariants. We think that at this moment it may 
be complicated and difficult to find the generators of Pol^™'. 

We propose the following problems. 

Problem 1. Find the generators of Pol^^. Are there canonical ways to find al- 
gebraically independent generators of Pol^^ like Shimura's way in the hermitian 
symmetric space case ? 

Problem 2. Find an easy way to express the images of the above invariant polyno- 
mials under the map 9 explicitly. 
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For g = (M, (A,/i; k)) G G j with M = ^ j G 5p(n,R) and (0, Z) G H n>TO , 
we set 

f]* = M-fi = X* +i Y*, X*,F*real, 

Z* = (Z + XQ + ^iCQ + D)- 1 = U*+iV*, C/*,Kreal. 

For a coordinate (fi, Z) G H n/m with = {uo^ v ) and Z = (zjm), we put dO, G?f2, J= 
as before and set 

Z 
dZ 



U + iV, U = (u H ), V = (v H ) real, 
(dz k i), dZ = (dz k i), 



_d_ 

dZ 



\dz ln 



-9- I 

9z m n / 



_d_ 

dZ 



\9zin 



9Zn 



d~Zmn / 



Then we can show that 

(3.18) dn* = t {Ctt + D)- 1 dQ{CQ + D)-\ 
= dZ(CVL + D)- 1 

+ {A - (Z + XQ + //)(CQ + Z?) -:L C} dfi(C7n + D)-\ 



(3.19) dZ* 




(3.20) 

and 
(3.21) 



on 



-(cn + D^c'z + c^-D'x) '(Jz)} 



d d 



From [TOl p. 33] or [HJ p. 128], we know that 

(3.22) Y* = \CQ + D)- l Y(CVL + D)' 1 = \CQ + D)- l Y(Cll + D)' 1 . 

Using Formulas (3.18), (3.19) and (3.22), the author [22] proved that for any two 
positive real numbers A and B, 



B ^trfY-^VVY^dQY^dtt^ + tr(y -1 *(dZ) dz) 



-ti\V Y^dnY^^dZ)) - ti\V Y- l dVLY- lt (dZ) 
is a Riemannian metric on H n m which is invariant under the action (1.2) of G J . 
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Using Formulas (3.20), (3.21) and (3.22), we can prove that the following differential 
operators Mi and M 2 on M ntTn defined by 

d V d 



(3.23) 
and 
(3.24) 



tr Y 



dZ \dZ 



on J on 

dVL dZ 



+ tr I VY- 1 *V I Y 



d \ d 



dZ dZ 



tr *y [Y 



d \ d 



dZ dtt 



are invariant under the action (1.2) of G J . The author [22] proved that for any two 
positive real numbers A and B, the following differential operator 



(3.25) 



4 4 

&n,m;A,B= jM 2 + -M X 



is the Laplacian of the G J -invariant Riemannian metric ds 1 nm . AB . 
Let 

n n = {w e c (n ' n) \w=*w, i n - ww > o } 

be the generalized unit disk. 

For brevity, we write H) n ,m := D n x C (m ' n) . For a coordinate (W,7?) G D n , m with 
W = (w^) G D n and 7] = (r) kl ) G € {m ' n \ we put 

dW = (dw^), dW = (dw^), 
dr] = (dr] k i), drj = (dJ] kl ) 



and 



d 

dW ' 

d_ 

drj 



1 + 5^ d 



dw 



/ a a 

' dr)u ' ' ' drjmi 



dr]mn / 



d 
~dW 

d_ 

drj 



1 + <V d 



dw 



V _JL_ 

\9Vlr, 



d 



d 

&0mn 



We can identify an element g = (M, (A,/i; k)) of G J , M 
with the element 

(A B A t fi-B t \\ 
X I m /i K 

COD CV-^*A 

\o o o / m y 



G Sp(n,M) 



of Sp{m + n, ' 
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We set 

rp \ ( Im+n Im+n \ 

We now consider the group G'l defined by 

Gl := T-WT*. 

Hg = (M, (A, fi;K)) E G J with M = E Sp(n, R), then T^gT* is given by 

(3-26) T-'gT^f^ %) , 



Q* P., 

where 

P i{Q ( (A + V )-? ( (A- v )}\ 

Q \{P\\-in)-Q\\ + in)} 

?'- 



P* = 



and P, Q are given by the formulas 

(3.27) P= l -{{A + D)+i{B-C)} 
and 

(3.28) Q= l - {(A-D)- i(B + C)}. 
From now on, we write 

% ?)'G( A+< ^^ A -^ ; -^)) := (t ?; 

In other words, we have the relation 

g pJ,^(A + .^),-(A-.^);-.- 
Let 

H ( c' m) ■■={^V,0\^,veC^ n \ (eC( m ' m », C + ^'e symmetric} 
be the complex Heisenberg group endowed with the following multiplication 

(£, v ; o (£', i/; CO := (£ + 17 + V ; C + C + £ V - ^ V))- 

We define the semidirect product 

SX(2ra, C) k if£ n,m) 
endowed with the following multiplication 



(fl s) (£ ^.tf + ^WiC + C + IV-fl'f)), 
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where £ = £P' + 7/P' and 77 = £Q' + 77 5". 
If we identify H^'™^ with the subgroup 

of H^ L ' m \ we have the following inclusion 

G # J c ST7(n,n) k ^ n ' m) c SL(2n,C) k ^ n ' m) . 
We define the mapping 9 : G J — > by 



(3.29) 0^ ^j,(X,^K 



P Q\ /1 M . . 1 M . . .K 
Q p)'U (A + l/i) ' 2 (A ~ 2/i);_i 2 



where P and Q are given by (3.27) and (3.28). We can see that if (71,(72 G G J , then 

0(9192) = e^oe^). 

According to [201 P- 250], G* is of the Harish-Chandra type (cf. [TU p. 118]). Let 

9 * = ((C f) '^'^ 7 

/p Q 

be an element of Gf . Since the Harish-Chandra decomposition of an element ( ^ ^ 
in 577 (n, n) is given by 

P Q\ = (in QS- X \ (P - QS-'R 0\ / I n 

R S) \0 In J \ Syl ^S^R I n 

the P+-component of the following element 

9*- ((q™ *Q,(0,77;0)J, W^GD n 
of SX(2n, C) K P^ n,m) is given by 

(3.30) (('» + + , (o, (, + A^ + rt(QW + P)-';0)) . 

We can identify D njm with the subset 

{ (( o" I) ' (0 ' ^ ; 0) ) I w G ^ G c(m ' n) } 

of the complexification of Gf. Indeed, D njm is embedded into P+ given by 

p+ = { ( ( Q n *Q , (0, m o])\w=*We C^ n \ r] e J . 
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This is a generalization of the Harish-Chandra embedding (cf. [Til p. 119]). Then we 
get the natural transitive action of on D n>m defined by 

(3-31) (J£ (W,ij) 

= ({PW + Q) (QW + P) - 1 , (77 + £W + (QW + P) - 1 ) , 

where ^ 6G„(e C( m > n ), k G M (m - m) and (W,t?) G B„, m . 

The author [23] proved that the action (1.2) of G J on H n>m is compatible with the 
action (3.31) of Gl on V> n ,m through a partial Cayley transform $ : D n m — > H njm 
defined by 

(3.32) $(W,ri) := (i(I n + W)(I n - W)'\ 2 i v (I n - Wy 1 ^. 
In other words, if g G G J and (W, r/) G O ni7n , 

(3.33) # • <K^) = (^)), 

where = T~ 1 g T*. $ is a biholomorphic mapping of D n m onto H n m which gives 
the partially bounded realization of EI n)m by D n m . The inverse of $ is 

^-\n,z) = ((n-ii n )(n + n n y l , z^ + z/^- 1 ). 

For (W,rj) G D n , m , we write 

(n,Z):=$(W, V ). 

Thus 

(3.34) ft = i(I n + W)(I n - Z=2ir,(I n - W)~\ 
Since 

d(j n - wy 1 = (i n - wy'dw {i n - wy 1 

and 

i n + {i n + w){i n - wy 1 = 2 {i n - wy 1 , 

we get the following formulas from (3.34) 



(3.35) 


Y = 


1 (ft - ft) = (J n - W)-\l n - WW){I n ~ W 


(3.36) 


V = 


l-{Z-Z) = r ] {I n -Wy 1 + r]{I n -Wy\ 


(3.37) 


dn = 


2i{i n -wy l dw {i n -wy\ 


(3.38) 


dZ = 


2i{dr ) + r ] {In - Wy l dW }(/„ - W)~ l . 
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Using Formulas (3.32), (3.34)-(3.38), we can prove that for any two positive real 
numbers A and B, the following metric ds nm . AB defined by 



i-,A,B 



+ ■ 



= 4Atr((/ n -lW)-W(/ n - WW)' l dW^j 
4 B jtr((/ n - WW)" 1 \dri) /?) 

+ tr((??W-?7)(7 n - WW)- 1 dW{I n -WW)- lt {drj) 
+ tr((77W - 77) (J n - WW)- 1 dW(I n - WW)" 1 \dr}) ) 
-tr((7„ - ^IF)- 1 *77?7(7 n -TFw)- 1 TFdW(7„-TFw)-W) 
-tr(^(7„- WW)" 1 *????^ - ^f)-W(/ B -W) _ W) 
+ tr((7 n - WWy u r]r](I n - WW)~ 1 dW(I n - WW)~ 1 dW^j 
+ tr((7„ - W)" 1 l l}riW{I n - WW)~ 1 dW{I n - WW)~ x dW^ 
+ tr((7 n - W)-\l n - W)(I n - WW)" 1 trjn (I n - WW)' 1 

x (7 n -W){I n - W)- 1 dW(I n -WW)- 1 dW^j 
-tr((7„ - WW)-\l n - W^In-Wy^rjr] (7 n - W)" 1 

x dW(I n -WW)~ 1 dW 



is a Riemannian metric on D„ im which is invariant under the action (3.31) of the 
Jacobi group G*. 

We note that if n — m — 1 and A = B — 1, we get 



l -ds 2 

4 "%i,i 



1 



i,i 



(l-\W\ 



2\2 



(1 - \W\ 



drj drj 







2 )M 


2 - Wrf - Wrf 


(1- 


\W 


2)3 



dWdW 



K vW :l, dwd^ + f w -" dWd V . 



(1-\W\ 2 ) 2 1 (1-\W\ 2 ) 2 
From the formulas (3.34), (3.37) and (3.38), we get 



(3.39) 



_d_ 



1 

2i 



(In ~ W) 



\di] 
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and 

< 3 ' 40 > iz-h^- w ^ 

The following lemma is very useful for computing the invariant differential opera- 
tors. H. Maass [9] observed the following useful fact. 

Lemma 3.1. (a) Let A be an m x n matrix and B an n x / matrix. Assume that 
the entries of A commute with the entries of B. Then t (AB) = t B t A. 

(b) Let A, B and C be a k x I, annxm and an m x / matrix respectively. Assume 
that the entries of A commute with the entries of B. Then 



\A \BC)) = B \A t C). 

Proof. The proof follows immediately from the direct computation. □ 

Using Formulas (3.34)-(3.36), (3.39), (3.40) and Lemma 3.1, we can prove that the 
following differential operators Si and S2 on D„ jm defined by 

Sl= J { I n -WW)^(£ 



and 



^[{In-WW)\ { I n -WW)^)^ 

+ tr [(rj-rjW) ( (I n - W\V)-t=^ " 



dW J Ot] 

-tr (^W{I n -WW)- l ^[^j (I n -WW)^ 
-tr (rjW{I n - WW)~ lt fj (JA {I n -WW)^~ 
+ tr (rj(I n - wW)- u v(^ (In-WW)-^ 
+ tr (ijWW(I n - WW)' 11 !) ( (I n -WW) '° 



drj J drj 
are invariant under the action (3.31) of G{. We can prove that 

(3-41) A D „ ira;AB := is 2 + iSi 

is the Laplacian of the invariant metric dsg . A B on D n m (cf. |25j). 
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Using (3.21), (3.22) and Lemma 3.1, we can see that the following differential op- 
erator K on M ntm of degree 2n defined by 

d V d 



K= det(y) det — ^ 
1 dZ\dZ 



(3.42) 

is invariant under the action (1.2) of G J . In fact, if / is a C°° function on M. n ,m, 



KJ = det(y) \det(CQ + D)\~ 2 det 
= det(y) Idet^fi + D)!" 2 det 



= det(y) \det(CQ + D)\~ 2 det 



{cn + d) 



d_ 

~dZ 
tr 



t( - df 

{CQ + D) 



(cn + D)^(cn + D 

d Vdf 

(cn + d) 11 



dZ 

t/ Q t/Qf 



dZ \dZ 



dZ \dZ 
\CU+D) 



= det(y) det 
= K/, 

where IK* denotes the image of IK under the transformation 

(n, Z) i— > (ft*, Z*) = ((M-fi, (Z + Aft + ^)(L7ft + d)- 1 ) 

with M= e Sp(n,R) and (A,//; k) G /4"' m) - 

From (3.35), (3.40) and the fact that the action (1.2) of G J on H nim is compatible 
with the action (3.31) of G* on D n rn via the partial Cayley transform, we see that 



(3.43) 



^B„, m = det(I n -WW) det 11 ' 



drj \dfj 



is a G*-invariant differential operator on D njr , 



Using (3.21), (3.22) and Lemma 3.1, we can show without difficulty that the matrix- 
valued differential operator T on M. nm defined by 



(3.44) 



T 



"_d\ y ± 
dZ dZ 



is invariant under the action (1.2) of G J . Therefore each (k, /)-entry T ki of T given 
by 



(3.45) 



T 



ki 



o 2 



dzkidzu ' 



1 < k, I < m 



is an element of D(H„ jm ). From (3.35), (3.40) and the fact that the action (1.2) of 
G J on M n>m is compatible with the action (3.31) of Gj on D n m via the partial Cayley 
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transform, we see that 

(3.46) !■>:= f (|)(/„ -WW)L 

is a Gf-invariant matrix-valued differential operator on D n m . Thus each (k, /)-entry 
T» of T D given by 



(3-47) 1^=E K--£ B ^ W *-) J^-' 1<M<™ 

jj=l \ r =l / Iki I ] 

is a G^-invariant differential operator on D r 



Indeed it is very complicated and difficult at this moment to express the generators 
of the algebra of all G^-invariant differential operators on D n m explicitly. In par- 
ticular, it is extremely difficult to find explicit G^-invariant differential operators on 
D n m of odd degree. We propose an open problem to find other explicit G^-invariant 
differential operators on D„ >m . 

Example 3.2. We consider the case n — m — 1. For a coordinate (uj,z) in T ljl: we 
write u = x + i y, z = u + iv, x,y,u,v real. Then the algebra Pol^^ is generated by 

1 i 

Q(u,z) = -ujuj= -(x 2 + y 2 ), 

z) — zz = u 2 + v 2 , 
I I 
4>{u), z) = - Re (z 2 tu^ = - {u 2 — v 2 )x + uvy, 

ip(u, z) = - Im (z 2 ZJ) = — (v 2 — u 2 )y + uvx. 

We put 

£>i = 6(g), £> 2 = e(0, D 3 = 0(0) and £> 4 = O(^). 

Using Formula (3.3), we can show that the algebra ©(H^x) is generated by the 
following differential operators 



dx 2 dy 2 J \ du 2 dv 2 

( d 2 2 \ 
^ V \ dxdu dydv J ' 



D 2 = y — + 



d 2 d 2 



du 2 dv 2 
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2 d ( 8 2 d 2 \ „ d 3 



and 



dy \ du 2 dv 2 J dxdudv 



2 8 ( d 2 d 2 \ 2 & 



<9x \ <9u 2 oYi 2 / dydudv 
ou 

where t = x + iy and z = u + iv with real variables x, y, u, v. Moreover, we have 

2 d ( d 2 d 2 



D 1 D 2 -D 2 D l = 2y< — 

ay \ aw 2 av z 

„ d 3 ( 8 

-4y 2 -2 v — L> 2 + J D 2 

oxouov \ av 

In particular, the algebra ©(HI^i) is not commutative. We refer to [H [21] for more 
detail. 
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